Claim Amendments 



1. (Currently Amended) A method comprising: 

requesting identification of a first object in association with a capture of an image^ 
the requesting made over at least two channels, including a channel adapted for use bv 
a cell phone and a channel adapted for use bv a laptop computer : 

receiving a first identifier, responsive to the requesting operation, the first 
identifier identifying the first object in the image; 

selecting, based on the first identifier, a subset sub-portion of a library of potential 
matches, wherein the subs e t sub-portion is less than the library of potential matches, 
and 

Identifying a second object that is shown in the image separately from the first 
object using the selected subs e t sub-portion of the library potential matches, the second 
object being identified by a second identifier that is different from the first identifier. 

2. (Previously Presented) The method of claim 1 wherein the first object Is 
an active object, and the identifier of the active object is received from the active object. 

3. (Previously Presented) The method of claim 1 wherein at least one of the 
objects is a delegate object, and wherein the identifier of the delegate object is received 
from another object. 
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4. (Original) The method of claim 1 further comprising: 

capturing the image, wherein an image capture device performs the requesting, 
receiving, and capturing operations. 



5. (Canceled) 

6. (Original) The method of claim 1 further comprising: 
extracting a model associated with the identifier from a model library. 

7-9. (Canceled) 

10. (Original) The method of claim 1 further comprising: 
associatively storing with the image one or more parameters relating to the object 
identified in the image. 
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11. (Currently Amended) A comput e r program product e ncod i ng a comput e r 
program storage medium readable by a computer system, the storage medium 
encoding a computer program that when executed on [[a]] the computer system causes 
the computer system to perform a computer process, the computer process comprising: 

requesting identification of a first object in association with a capture of an image; 

receiving a first identifier, responsive to the requesting operation, the first 
identifier identifying the first object in the image; 

selecting, based on the first identifier, a subs e t sub-portion of a library of potential 
matches, wherein the subs e t sub-portion is less than the library of potential matches, 
and wherein the sub-portion of the library includes a hierarchy of models, the hierarchy 
of models including a base model to roughly identify an object and specialized models 
to refine the rough identification; and 

identifying a second object that is shown in the image separately from the first 
object using the selected subs e t sub-portion of potential matches, the second object 
being identified by a second identifier that is different from the first identifier. 

12. (Currently Amended) The comput e r program product storage medium of 
claim 1 1 wherein the first object is an active object, and the identifier of the active object 
is received from the active object. 

13. (Currently Amended) The comput e r program product storage medium of 
claim 1 1 wherein at least one of the objects is a delegate object, and wherein the 
identifier of the delegate object is received from another object. 
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14. (Currently Amended) The comput e r program product storage medium of 
claim 1 1 wherein the computer process further comprises: 

capturing the image, wherein an image capture device performs the requesting, 
receiving, and capturing operations. 

15. (Currently Amended) The comput e r program product storage medium of 
claim 1 1 wherein the computer process further comprises: 

associating the identifier with the image. 

16. (Currently Amended) The comput e r program product storage medium of 
claim 1 1 wherein the computer process further comprises: 

extracting a model associated with the identifier from a model library. 

17-19. (Canceled) 

20. (Currently Amended) The comput e r program product storage medium of 
claim 1 1 wherein the computer process further comprises: 

assoclatlvely storing with the image one or more parameters relating to the object 
identified in the image. 
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21. (Currently Amended) A system comprising: 
a processor; 

a memory coupled to the processor; 

a signaling module coupled to a digital capture device and configured to request 
identification of a first object in association with a capture of an image; tlie signaling 
module further configured to receive a first identifier identifying the first object in the 
image, responsive to requesting identification; 

an identifying module configured to select, based on the first identifier, a subs e t 
sub-portion of a library of potential matches, the sub-portion of the library including a 
hierarchy of models, the hierarchy of models including a base model to roughly identify 
an object and specialized models to refine the rough identification of the obiect. the sub- 
portion being wh e r ei n th e subs e t i s less than the library of potential matches, and to 
identify a second object that is shown in the image separately from the first object using 
the selected subs e t sub-portion of potential matches, the second object being identified 
by a second identifier that is different from the first identifier. 

22. (Previously Presented) The system of claim 21 wherein the first object is an 
active object, and the identifier of the active object is received from the active object. 

23. (Previously Presented) The system of claim 21 wherein at least one of the 
objects is a delegate object, and wherein the identifier of the delegate object is received 
from another object. 
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24. (Previously Presented) The system of claim 21 further comprising: 
an image capture module configured to capture the image. 

25. (Previously Presented) The system of claim 21 further comprising: 

a registration module configured to associate the identifier with the image. 

26. (Previously Presented) The system of claim 21 further comprising: 

a model extractor configured to extract a model associated with the identifier 
from a model library. 

27. (Previously Presented) The system of claim 21 further comprising: 

a model extractor configured to extract a model associated with the identifier 
from a model library; and 

an object matching module configured to evaluate the image using the model to 
determine whether the object is in the image. 

28-29. (Cancelled) 

30. (Previously Presented) The system of claim 21 further comprising: 

an image storage module configured to associatively store with the image one or 
more parameters relating to the object identified in the image. 

31. -36. (Canceled) 
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37. (Currently Amended) The method of Claim 1 , wherein the first object does 
not identify the second object and wherein the selected subs e t sub-portion of potential 
matches refers to objects that are not components of the first object. 

38. (Previously Presented) The method of Claim 1, wherein the library of 
potential matches comprises visual image models, and the identifying the second object 
comprises comparing the visual image models with the captured image to identify the 
second object. 

39. (Currently Amended) The comput e r program product storage medium of 
Claim 11, wherein the first object does not identify the second object and wherein the 
selected subs e t sub-portion of potential matches refers to objects that are not 
components of the first object. 

40. (Previously Presented) The comput e r program product storage medium of 
Claim 11, wherein the library of potential matches comprises visual image models, and 
the Identifying the second object comprises comparing the visual image models with the 
captured image to identify the second object. 

41. (Currently Amended) The system of Claim 21, wherein the first object does 
not identify the second object and wherein the selected subs e t sub-portion of potential 
matches refers to objects that are not components of the first object. 
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42. (Previously Presented) The system of Claim 21, wherein the library of 
potential matches comprises visual image models, and the identifying module is 
configured to identify the second object by comparing the visual image models with the 
captured image. 

43. (New) A method comprising: 
capturing an image; 

transmitting a request for identification, the transmitting made over at least two 
channels, the at least two channels being different channels; 

receiving, in response to the request for identification, a response from two or 
more objects, including a response from at least one object not actually in the image; 

extracting, from a model datastore, models associated with the response, the 
extracting including relevant models and excluding other models; 

evaluating the image, using the extracted relevant models, to determine objects 
within the image; and 

annotating the image with parameters for objects found in the image. 

44. (New) The method of claim 43, wherein the image is a video image and 
wherein the transmitting of the request is performed in response to a significant scene 
change in the image. 
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45. (New) The method of claim 43, wherein extracting relevant models comprises 
extracting only models related to indoor objects or extracting only models related to 
outdoor objects. 

46. (New) The method of claim 43, wherein extracting relevant models comprises 
extracting a hierarchy of models, the hierarchy of models including a base model to 
roughly identify an object and specialized models to refine the rough identification. 

47. (New) The method of claim 43, wherein extracting models includes extracting 
parameterized models, the parameterized models distinguishing an open laptop from a 
closed laptop. 

48. (New) The method of claim 43, wherein extracting relevant models comprises 
extracting a sub-portion of models from the model datastore based on brand of 
manufacturer. 



Serial No.: 10/659,121 

Atty Docket No.: MS1-1636US 

Atty/Agent: David S. Thompson 




www.leehayes.com » 509.324.9256 



49. (New) A method comprising: 
capturing an image; 

transmitting a request for identification, tine transmitting made over at least two 
channels, including a channel adapted for use by a cell phone and a channel adapted 
for use by a laptop computer; 

receiving, in response to the request for identification, a response from two or 
more objects, including a response from at least one object not actually in the image; 

extracting, from a model datastore, models associated with the response, the 
extracting including relevant models and excluding non-relevant models, the extracting 
including: 

extracting only models related to indoor objects or extracting only models 
related to outdoor objects; 

extracting a hierarchy of models, the hierarchy of models including a base 
model to roughly identify an object and specialized models to refine the rough 

identification; 

extracting parameterized models, the parameterized models distinguishing 
an open laptop from a closed laptop; and 

extracting a sub-portion of models from the model datastore based on 
brand of manufacturer; and 

evaluating the image, using the extracted relevant models, to determine objects 
within the image. 
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50. (New) The method of claim 49, wherein the image is a video image and 
wherein the transmitting of the request is in response to a significant scene change in 
the image. 

51. (New) The method of claim 1, wherein a first channel of the at least two 
channels is adapted for use by a cell phone and a second channel of the at least two 
channels is adapted for use by a laptop computer. 
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